Pii: S0893-6080(98)00051-3
نویسندگان
چکیده
We propose a method for optimizing the complexity of Radial basis function (RBF) networks. The method involves two procedures: adaptation (training) and selection. The first procedure adaptively changes the locations and the width of the basis functions and trains the linear weights. The selection procedure performs the elimination of the redundant basis functions using an objective function based on the Minimum Description Length (MDL) principle. By iteratively combining these two procedures we achieve a controlled way of training and modifying RBF networks, which balances accuracy, training time, and complexity of the resulting network. We test the proposed method on function approximation and classification tasks, and compare it with some other recently proposed methods. q 1998 Elsevier Science Ltd. All rights reserved.
منابع مشابه
An efficient MDL-based construction of RBF networks
We propose a method for optimizing the complexity of Radial basis function (RBF) networks. The method involves two procedures: adaptation (training) and selection. The first procedure adaptively changes the locations and the width of the basis functions and trains the linear weights. The selection procedure performs the elimination of the redundant basis functions using an objective function ba...
متن کاملPii: S0893-9659(98)00051-2
The motivation for the work reported in this paper accrues from the necessity of finding stabilizing control laws for systems with randomly varying bounded sensor delay. It reports the development of reduced-order linear unbiased estimators for discrete-time stochastic parameter systems and shows how to parametrize the estimator gains to achieve a certain estimation error covariance. Both finit...
متن کاملAdaptive natural gradient learning algorithms for various stochastic models
The natural gradient method has an ideal dynamic behavior which resolves the slow learning speed of the standard gradient descent method caused by plateaus. However, it is required to calculate the Fisher information matrix and its inverse, which makes the implementation of the natural gradient almost impossible. To solve this problem, a preliminary study has been proposed concerning an adaptiv...
متن کاملA model of dopamine modulated cortical activation
Standard techniques from pharmacology and current theories on the biochemistry of dopamine (DA) are used to derive a new model of how DA modulates cortical activation. The model assumes that DA potentiates the glutamate response through the NMDA receptor and depresses the glutamate response through non-NMDA receptors. A static version of the model is used to examine the neurobiological plausibi...
متن کاملExplanation of the "virtual input" phenomenon
We write this letter to comment on the "virtual input" phenomenon reported by Thaler (Neural Networks, 8(1) (1995) 55-65). The author attributed the phenomenon to the network's ability to perform pattern classification and completion, and reported that pruning probability affects the number of virtual inputs observed. Our independent study of Thaler's results, however, reveals a simpler explana...
متن کامل